EUROPEAN LABORATORY FOR PARTICLE PHYSICS 



CERN-EP/98-118 
20 July 1998 



Study of D°-D° Mixing and 
D° Doubly Cabibbo-Suppressed Decays 



The ALEPH Collaboration* 



Abstract 

Using a sample of four million hadronic Z events collected in ALEPH from 1991 to 
1995, the decays D* + — ► D°7r+, with D° decaying to K~7r + or to K + 7r~, are stud- 
ied. The relative branching ratio B(D° — > K + 7r~)/Z?(D° — > K~7r + ) is measured to be 
(1.84 ± 0.59(stat.) ±0.34(syst.))%. The two possible contributions to the D° -> K+tt" de- 
cay, doubly Cabibbo-suppressed decays and D°-D° mixing, are disentangled by measuring 
the proper-time distribution of the reconstructed D°'s. Assuming no interference between 
the two processes, the upper limit obtained on the mixing rate is 0.92% at 95% CL. The 
possible effect of interference between the two amplitudes is also assessed. 
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1 Introduction 



The D° can produce a K + 7r~ system either via a doubly Cabibbo-suppressed decay 
(DCSD) or via the oscillation of the D° into a D° followed by the Cabibbo-favoured 
decay D° — > K + tt~ . The rate of DCSD processes D° -> K+ 7r is expected to be of the 
order of 2tan 4 6 l c ~ 0.6% |IJ, where 9c is the Cabibbo angle. Within the framework of 
the Standard Model the D°-D° mixing rate -R m i x is expected to be well below present 
experimental bounds [Q, |3|]. While short distance effects from box diagrams are known 
to give a small contribution (i? m i x ~ 10~ 10 ) H, long distance effects from second-order 
weak interactions with mesonic intermediate states may give a much larger contribution 
but are subject to large theoretical uncertainties (i? m ix ~ 10~ 7 — 10~ 3 ) |]5[. 

There are many extensions of the Standard Model which allow a D°-D° mixing 
rate significantly larger than the Standard Model prediction, for example models with 
leptoquarks, with two-Higgs-doublet, with fourth quark generation and supersymmetric 
models with alignment |], [7|]. Experimental evidence for mixing within the current 
experimental sensitivity would therefore be an indication of new physics. 

The search for DCSD or mixing necessitates the identification of a change in the charm 
quantum number between production and decay of the D°. The method presented here 
consists of reconstructing the D* + — ► D ^ decay where the charge of the slow pion 
indicates whether a D° or a D° is produced. The charge of the kaon in the subsequent 
D° — > K-7T decay tags the charm flavour at decay. The relative contributions of the DCSD 
process and the D°-D° mixing are assessed by studying the proper-time distribution of 
the reconstructed D°'s. 



2 ALEPH Detector and Data Selection 

This analysis uses data collected in the vicinity of the Z peak from 1991 to 1995 with the 
ALEPH detector at the LEP electron-positron storage ring. The data sample consists of 
about four million hadronic Z decays that satisfy the criteria of Ref. ||. 

A detailed description of the design and performance of the apparatus can be found in 
Refs. H 10], and only a brief summary of the features relevant to this study is given here. 
A double-sided silicon vertex detector (VDET), surrounding the beam pipe, is installed 
close to the interaction region. The single-hit resolution for the rcf) and z projections is 
12 /im. Outside the vertex detector are an eight-layer drift chamber, the inner tracking 
chamber (ITC), and a large time projection chamber (TPC). These three detectors form 
the tracking system, which is immersed in a 1.5 T axial magnetic field. Using the VDET, 
ITC and TPC coordinates the particle momentum transverse to the beam axis is measured 
with a resolution of Sp^/pT = 6 x 10 _4 pr © 5 x 10~ 3 (pr in GeV/c). 

The TPC also provides up to 338 measurements of the specific ionization of a charged 
particle. In the following, the dE/dx information is considered as available if more than 
50 samples are present. Particle identification is based on the dE/dx estimators \n (Xk), 
defined as the difference between the measured and expected ionization expressed in 
terms of standard deviations for the 7r (K) mass hypothesis. For charged tracks having 
momentum above 2 GeV/c a pion/kaon separation of 2a is achieved. 
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3 Measurement of B(D° K+tt") /B(D° R-7T+) 

Starting from the sample of hadronic Z decays the D* 1 * 1 are reconstructed as follows. Each 
pair of oppositely-charged tracks is considered with the two mass assignments K~7r + and 
7T _ K + and those with | M(Kir) — M^o |< 30 MeV/c 2 are retained. If both hypotheses 
satisfy the mass cut the event is rejected. In addition, the measured mean ionization 
of each track is required to be closer, in terms of number of standard deviations, to the 
expectation for the assumed mass hypothesis than for the alternative hypothesis. The 
decay angle 8^ of the kaon in the D° rest frame is required to satisfy | cos 6^ |< 0.8. Only 
combinations in which the two tracks form a common vertex and each track has at least 
one VDET hit are kept. 

To build the D* 1 * 1 candidate the surviving track pairs are combined with an extra 
charged track, the "soft pion" (tt s ), of low momentum, typically less than 4 GeV/c [11 



(the limits on momentum are fixed by kinematics and resolution effects). In order to 
reduce the combinatorial background, the energy of the D* 1 * 1 candidate is required to be 
greater than half the beam energy. 

The Cabibbo-favoured decays of the D° and D° are contained in the sample for which 
the two pions have the same sign (right-sign sample), while the DCSDs and mixing 
candidates are contained in the sample for which the two pions have opposite sign (wrong- 
sign sample). The AM = M WsD o — M D o distributions of the right-sign and wrong-sign 
samples are shown in Fig. [I] together with the estimated combinatorial background. The 
shape of this combinatorial background is assumed to be the same as that obtained from 
events in the sideband region of the D° invariant mass distribution above 2.1 GeV/c 2 , and 
is normalised to the number of candidates having AM > 160 MeV/c 2 . 

Within a AM mass window from 143.5 MeV/c 2 to 147.5 MeV/c 2 the numbers of 
events in the right-sign and the wrong-sign samples after the combinatorial background 
is subtracted are 

N RS = 1038.8 ± 32.5(stat.) ± 4.3(syst.) , 

iV W s = 21.3 ± 6.1(stat.) ± 3.4(syst.) , 

respectively. The systematic error is due to the limited statistics used to determine the 
combinatorial background. 

Monte Carlo studies show that, although the physics background contamination in 
the right-sign sample is negligible, a small contribution from physics backgrounds must 
be subtracted from the wrong-sign sample. Four decay modes are found to contribute, 
namely: D° -> K-7r+(7r°), D° -> tt>+z/ m , D° -> tt+tt-tt and D° -> K~K+ They 
contribute because of misidentification of one or both tracks or because of missing 
neutrinos or 7T°s. 

To demonstrate that the peak appearing in Fig. |l|b is not related to combinatorial 
background, events are selected in the AM mass window and the cut on M(Ktt) for the 
wrong-sign sample is not applied. The resulting M(Ktt) distribution is shown in Fig. [| 
A narrow peak at the nominal D° mass (M D o = 1864.5 GeV/c 2 ) is present. The peak on 
the left, due to D° — > K~K + decays, is outside the D° mass window. 

Rather than relying on the Monte Carlo estimates for the physics background 
subtraction, the data are used to estimate the contribution of the dominant D° — ► 
K~7r + (7T°) physics background to the wrong-sign sample. This is achieved by repeating 
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the selection, with the dE/dx requirement reversed, i.e. the ionization of the kaon (pion) 
candidate has to be closer to the expectation for a pion (kaon). This sample is hereafter 
called dE/dx. In this sample the D° — > K~7r + (7r°) contribution is strongly enhanced 
while the DCSD/mixing signal is suppressed by the same factor. The contributions from 
the other decay channels remain the same, since the cut is symmetric when the mass 
hypotheses are reversed. 

According to Monte Carlo studies, the dE/dx sample also contains some small 
additional physics backgrounds, from semileptonic D° decay channels, and these must 
also be taken into account. Table |I| shows the number of expected physics background 
candidates for the dE/dx and dE/dx samples, calculated from the Monte Carlo efficiencies 
and assuming the Particle Data Group |12| branching ratios. 



Channel 


dE/dx 


dE/dx 


D° 


-> K-7T+(7r°) 


1.56 ± 1.08 


26.48 ±4.16 


D° 


— > 7T~7r + 7r° 


0.36 ±0.36 


0.36 ±0.36 


D° 


-> n'/i+v^ 


0.16 ±0.16 


0.16 ±0.16 


D° 


-> K-K+ 


0.12 ±0.12 


0.12 ±0.12 


D° 


-> K-e+i/e 




3.16 ± 1.20 


D° 






0.84 ±0.64 



Table 1: Physics background estimated from the Monte Carlo with the standard and reversed 
dE/dx cuts. 



The expected contributions after the subtraction of the combinatorial background to 
the number of candidates of the wrong-sign sample, iV W s> and the number of candidates 

of the dE/dx sample, N^J dx , can be written as 
-Wws = iV D o 

— >K + 7T _ ± -Asymm (1) 

N WS dX = -^DO-K+tt- + rN Kn ^0) + N symm + A^ oth e r (2) 

where the various quantities are explicited hereafter. 

• -ZVdo^k+tt- is the unknown number of events attributed to the DCSD/mixing 
signal in the wrong-sign sample. 

• -^K7r(7T°) is the unknown number of events attributed to the dominant D° — ► 
K _ 7r + (7T°) physics background in the wrong sign sample. 

• r is the known enhancement factor for the D° — > K~7r + (7r°) contribution obtained 
when the dE/dx cut is reversed. This is measured in the data to be r = 46.1 ± 11.8, 
by applying the reversed dE/dx cuts to the right-sign sample and noting the 
reduction in the size of the peak from the Cabibbo-favoured D° decay. 
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• -^Vsymm is the estimate of the sum of the backgrounds which are symmetric upon 
reversal of the dE/dx cut, i.e. the D° — ► 7r~7r + 7r°, D° — > n~ [i + v^ and D° — > K _ K + 
backgrounds. iV symm is assumed to be rN Kn ( n o) ■ / symm , where / symm is the fraction 
of symmetric events with respect the number of K7r(7r°) events in the Monte Carlo 
dE/dx sample. The error on this number is taken to be 100% to take into account 
the differences, compatible with statistical fluctuations, found both for the dE/dx 
and dE/dx samples in Monte Carlo. 

• -Mother is the additional backgrounds expected in the dE/dx sample coming from 
D° — > K~e + z/ e and D° — > K~ decays. It is assumed to be rN Kn ^ - /other, where 
/other is also taken from the Monte Carlo estimate. The uncertainties are due to the 
limited statistics and to the errors on the branching ratios. 



Using the values N ws = 21.3 ± 6.1(stat.) ± 3.4(syst.), N^s = 56.4 ± 8.1(stat.) ± 
2.3(syst.) measured in the data, equations (1) and (2) yield 

N K n(n°) = 1-03 ± 0.15(stat.) ± 0.27(syst.) , 

iVoo^K+TT- = 19.1 ± 6.1(stat.) ± 3.5(syst.) . 

The total physical background (N Kn ( n o) + N symm ) is 2.2 ± 1.0 and is consistent with the 
Monte Carlo expectation of 2.2 ±1.2 from Table |l|. The systematic uncertainties for 
^d°->k+7t- are listed in Table || and are derived by varying the following quantities by 
one standard deviation: (i) the systematic uncertainty on iVws due to the combinatorial 

background subtraction, (ii) the statistical and systematic uncertainties on the N^J dx 
sample, (iii) the statistical uncertainty on r and finally (iv) the uncertainties on the 
physics background processes as discussed previously. 

Dividing iV D o_ +K + 7r - by the number of signal events in the right-sign sample (iV R g) 
yields a relative branching ratio of 

B(D° -> K+7i-)/B(D° -> K-7T+) = (1.84 ± 0.59(stat.) ± 0.34(syst.))% . 



Source 


Systematics 


Syst. error on iVws 


±3.4 


Stat, error on N^J dx 


±0.3 


Syst. error on iv ws 

r = effic. (dE / dx) /effic. (dE / dx) 

Fractions of physics background 


±0.1 
±0.3 
±0.9 


Total 


±3.5 



Table 2: Systematic uncertainties for the measurement of the number of D° — > K + 7r decays. 
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4 Proper Time Distribution 



Assuming small mixing and neglecting CP-violating terms, the time evolution for the 
signal in the wrong sign sample is expected to have the following form [|13 | 



N D o_ K+7T - (t) oc 



-Rdcsd + V 2R mix R BC sr>t/ r cos <\> + R m ix^(t/ rf 



e- t/T , (3) 



where -Rdcsd is the ratio of doubly Cabibbo-suppressed over Cabibbo-favoured decays, 
R m i x is the ratio B(D° — > D° — > K + 7r~)/.B(D — > K~7r + ) and cos0 is the phase angle 
parametrizing the interference between the two processes. The first term, due to the 
DCSD decay, has the conventional exponential proper time dependence with a decay 
constant given by the D° lifetime. The third term is the contribution from the mixed 
events and peaks at t/r = 2. The second term accounts for possible interference between 
both processes. The significant differences in the structure of the proper time distributions 
for the DCSD and the mixing signals allow their respective contributions to be estimated. 

The proper time t = of a D° candidate is calculated from the decay length £, 
defined as the distance between the primary vertex and the D° decay vertex projected 
along the direction of flight of the D°, and the reconstructed momentum p and mass M 
of the candidate. The average resolution on the proper time is ~ 0.1 ps and is dominated 
by the uncertainty on the position of the D° vertex. 

The distributions of proper time in the signal region for the wrong-sign sample observed 
in the data is shown in Figure §a. The result of a binned maximum likelihood fit is also 
shown. The following contributions are included in the probability density of the likelihood 
function: 

• A direct cc — > D°X component, which has the proper time dependence given by 
Eq. ^| convoluted with the detector resolution. The number of events attributed to 
the DCSD signal and the mixing signal are left free in the fit. Various assumptions 
for the phase of the interference term are investigated. 

The fraction of the signal which is attributed to cc — > D°X, (rather than the 
bb -> cc -> D°X discussed next) is / c K7r = (77.0 ± 2.7(stat.) ± 0.5(syst.))%. It is 
extracted from the data using a likelihood fit to the proper time dependence of the 
right-sign sample. This fit is essentially the same as the fit to the wrong-sign sample 
except that proper time dependence of the Cabibbo-favoured events is assumed to 
be exponential, as expected for small mixing, and the contribution accounting for 
the physics background is not necessary. The result of this fit is shown in Figure 0b. 

• An indirect bb — ► cc — > D°X component, which has the same proper time 
dependence as the direct component of the signal, but modified to take into account 
the effect of the additional flight distance of the B meson. The exact shape for this 
component is taken from Monte Carlo after appropriate reweighting for the world 



average B hadron and D lifetimes [JT2 



A physics background contribution for which the proper time dependence is assumed 
to be exponential with a decay constant given by the D° lifetime. The number of 
events attributed to this process is 2.2 ± 1.0, as determined in section 3. 
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bource oi uncertainty 


unconstrained fit 


constrained fit 


J- " mix 


AT 

jVdcsd 


AT 

jVdcsd 


Resolution 


< 0.1 


±0.1 


< 0.1 


D° lifetime 


< 0.1 


< 0.1 


< 0.1 


Comb. back, distribution 


±0.7 


±1.4 


±1.1 


Comb. back, rate 


±0.8 


±3.6 


±2.8 


Charm fraction 


±0.4 


±0.3 


±0.1 


Phys. back, rate 




±1.0 


±1.0 


Total 


±1.1 


±4.0 


±3.2 



Table 3: List of systematic uncertainties contributing to A^csd and iV m i x for the case of no 
interference. The constrained fit results are obtained with -/V m i x constrained to be non-negative. 

• A combinatorial background contribution, for which the proper time dependence is 
measured in the data from the sideband regions of the AM plot. The number of 
events attributed to this process is 15.7 ± 3.4 events. 

For all the above contributions, except the combinatorial background, an additional 
proper time smearing of (29 ± 12)% is applied to take into account that the proper time 
resolution measured in the data is slightly worse than that predicted by the Monte Carlo. 
This Monte Carlo/data comparison is performed by selecting candidates from the side 
band of the Kir mass distribution both in Monte Carlo and data and comparing the width 
of a Gaussian fit to the negative proper time distribution of these events. To enhance 
the fraction of tracks in this sample coming from the interaction point the contamination 
from cc and bb events is suppressed by applying to the opposite hemisphere the lifetime 
tag veto described in Ref. Hl4| . 

Setting the interference term to zero (cos</> = 0), the result of the fit to the proper 
time distribution of the wrong-sign sample is 

iVocsD = 20.8±^(stat.)±4.0(syst.) , 
AW = -2.0±4.4(stat.) ±l.l(syst.) . 

The fitted value for A mix is outside the physical region, thus no mixing is observed. Table || 
summarises all the sources of systematic uncertainty considered. They are computed by 
varying by one standard deviation on the fit the additional proper time smearing, the 
D° lifetime, the charm fraction and the combinatorial and physical background rates. 
The systematic uncertainties due to the combinatorial background proper time shape is 
evaluated by repeating the fit many times with a new combinatorial background shape, 
obtained by randomly varying the contents of each proper time bin according to a Poisson 
distribution. 

Figure ^ shows the time dependence of the ratio of wrong-sign over the right-sign 
candidates after the background subtraction. 

If A mix is constrained to be non-negative, the result is 

A DCSD = 18.4+^(stat.) ± 3.2(syst.) , 
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iVmix = +3 - (st a t.) +L4 (syst.) 

which translates to 

#dcsd = (l.77i°j°(stat.) ±0.31(syst.))% . 

In this case the systematic uncertainty on iV mix is obtained by adding to the likelihood used 
to fit the data, additional Gaussian terms for the extra smearing on the time resolution, 
the D° lifetime, the charm fraction and the physical background rate, and Poissonian 
terms for the combinatorial background rate and shape. Figure |5| shows the resulting 
likelihood as a function of the assumed mixed fraction. By integrating the resulting 
likelihood over the allowed region an upper limit of A^ mix < 9.6 at 95% confidence level is 
obtained, corresponding to 

R mix < 0.92% at 95% CL. 

The effect of interference has been studied by fitting the data with fully constructive 
(cos0 = +1) and fully destructive interference (cos0 = — 1); the respective upper limits 
are -R m i x < 0.96% at 95% CL and -R m i x < 3.6% at 95% CL. For the case cos0 = — 1 
N mix = 14.8l}|i(stat.) ± 3.3(syst.). 



5 Conclusion 

The D° — > K + 7r~ decay is studied to determine the branching ratio B(D° — > 
K + 7r~)/ B(D° — > K~7r + ). The method consists in reconstructing the D* + — > D°7r+ decay 
where the D° can subsequently decay to K + 7r~ or K~7r + . The numbers of reconstructed 
decays observed after background subtraction give 

B(D° -> K + 7i-)/B(D° -»■ K-7T+) = (1.84 ± 0.59(stat.) ± 0.34(syst.))% . 

This is 1.4 standard deviations from the CLEO Jl5[ measurement B(D° — > 
K+7T-)/ J B(D° -> K-7T+) = (0.77 ± 0.25(stat.) ± 0.25(syst.))%. 

In order to distinguish the two possible contributing processes, the fraction of 
doubly Cabibbo-suppressed decays -Rdcsd and D°-D° mixing rate -R m j x , the proper time 
distribution is analysed, yielding 

Rbcsb = (l.77^(stat.) ± 0.31(syst.))% , 

R mix < 0.92% at 95% CL , 

assuming no interference between the two processes. The fit is improved if destructive 
interference is allowed. 



This can be compared with the results obtained by the E691 Collaboration 
-Rdcsd < 1-5% at 90% CL based on the number of observed events A^dcsd = 



1.8 ± 13.2, and # mix < 0.5% at 90% CL. The E791 collab. finds .Rdcsd = 
(o.68loJ|(stat.) ± 0.07(syst.)) %, for R m i x = 0, in agreement within 1.5 standard 
deviations with our result, and sets a limit i? m i x < 0.85% at 90% CL allowing CP 
violation in the interference term. 
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Figure 1: Mass-difference distribution (a) for candidates of the decay channel D* + — > 
D°7r+, D° -> K-7T+ and (b) candidates of the decay channel D*+ -> D°tt+, D° -> K+vr-. 
The dots with error bars are data while the hatched histogram represents the distribution 
of the combinatorial background. 
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Figure 2: Mass distribution for candidates of the decay channel D* + — > D°7r+, D° — > 
K + 7r~. A narrow peak at the nominal D° mass (M^o = 1864.5 GeV/c 2 ) is present. The 
peak on the left is due to the decays D° — > K~K + and is fitted taking the shape from 
Monte Carlo. 
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Figure 3: Proper time distribution for (a) the D° — > K + 7r~ candidates, and (b) for 
the D° — > K~7r + candidates. The dots with error bars are the data. The histograms 
are the contributions of cc, bb and combinatorial background events resulting from the 
unconstrained fit when no interference is assumed. 
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Figure 4: Proper time distribution of the D° — > K + 7r _ over D° — > K~7r + candidates 
with the background subtracted. The dots with error bars are data. The errors are 
the sum in quadrature of statistical and systematic uncertainties due to combinatorial 
background subtraction. The solid curve is the fit result with no interference, the 
dotted and dashed curves are the fit results assuming fully constructive and destructive 
interference, respectively. 
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Figure 5: Likelihood of the fit as a function of -R m i x calculated by leaving free the -Rdcsd 
parameter and constraining all the external parameters within their uncertainties in order 
to take the systematic errors into account. The solid line represents the fit results with no 
interference, the dotted line is the likelihood for fully positive interference and the dashed 
line for fully negative interference. 
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